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Abstract 

We  present  a  technique  for  capturing  time-varying  volumetric  data 
of  participating  media.  A  laser  sheet  is  swept  repeatedly  through 
the  volume,  and  the  scattered  light  is  imaged  using  a  high-speed 
camera.  Each  sweep  of  the  laser  provides  a  near- simultaneous  vol¬ 
ume  of  density  values.  We  demonstrate  rendered  animations  under 
changing  viewpoint  and  illumination,  making  use  of  measured  val¬ 
ues  for  the  scattering  phase  function  and  albedo. 

1  Introduction 

Very  little  real  world  data  exists  for  time-varying  volumetric  phe¬ 
nomena.  We  present  a  technique  for  capturing  density  values  for 
particulate  scatterers  suspended  in  a  flowing  fluid,  and  apply  the 
technique  to  the  capture  of  smoke.  To  allow  accurate  rendering  un¬ 
der  arbitrary  view  and  illumination,  we  measure  the  single- scatter 
phase  function  and  albedo  of  the  medium. 

The  basis  of  our  technique  is  an  apparatus  that  allows  a  vertical 
sheet  of  laser  light  to  be  swept  horizontally  through  the  volume  of 
interest.  We  use  a  high-speed  camera  to  capture  the  scattered  light 
from  these  successively  illuminated  planes.  The  volume  scan  can 
be  repeated  many  times  per  second  to  allow  the  evolution  of  the 
volume  through  time  to  be  captured. 

2  Background 

In  the  computer  graphics  community,  several  groups  [Kass  and 
Miller  1990;  Stam  1999;  Fedkiw  et  al.  2001]  have  demonstrated 
efficient  fluid  simulators  appropriate  for  generating  realistic  smoke 
motion.  [Ihrke  and  Magnor  2004]  captured  time-varying  volumet¬ 
ric  data  of  a  flame  using  emission  tomography  from  sparse  views, 
using  an  estimate  of  the  flame  silhouette  to  constrain  the  solution. 

Volumetric  datasets  are  more  commonly  captured  in  disciplines 
such  as  medicine,  atmospheric  and  oceanic  sciences,  and  fluid  dy¬ 
namics.  Medical  techniques  such  as  CT  and  MRI  scans  acquire 
volumetric  measurements  of  densities  inside  the  body.  In  the  realm 
of  large  scale  atmospheric  measurements,  [Roy  and  Prevost  1993] 
scanned  cloud  density  using  a  lidar  scanner.  The  time  profile  of 
back-scattered  intensity  was  very  rapidly  digitized  for  many  differ¬ 
ent  points,  providing  a  3D  volume  of  cloud  density. 
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In  the  study  of  fluid  flow  and  mixing,  instantaneous  volumetric 
measurements  of  concentration  and  velocity  in  a  fluid  flow  have 
been  performed.  One  approach  has  been  to  illuminate  a  gas  with 
a  laser  sheet  or  laser  line  and  then  image  the  light  scattered  from 
the  gas  molecules.  Scattering  from  very  small  particles  (individual 
molecules  in  this  case)  is  known  as  Rayleigh  scattering.  It  is  very 
weak,  making  measurement  difficult.  Limiting  their  measurement 
to  points  and  lines,  [Pitts  1993]  focussed  light  to  sufficient  intensi¬ 
ties  to  measure  concentration  and  velocity  in  a  turbulent  flow.  [Yip 
et  al.  1986;  Yip  et  al.  1987]  performed  full  planar  measurements 
of  Freon  12  concentration  in  a  flow,  taking  advantage  of  its  strong 
Rayleigh  scattering  at  the  specific  wavelength  of  their  laser. 

Our  approach  falls  in  the  category  of  planar  Mie  scattering  tech¬ 
niques.  Mie  scattering  refers  to  scattering  of  light  from  particles 
much  larger  than  the  wavelength  of  light;  smoke  falls  in  this  cate¬ 
gory.  Mie  scattering  is  much  stronger  than  Rayleigh  scattering,  and 
has  been  exploited  for  instantaneous  2D  measurements  of  fluid  flow 
[Anderson  et  al.  1999;  Brummund  and  Scheel  2000]. 

Other  work  has  used  dyes  which  fluoresce  under  specific  wave¬ 
lengths  to  achieve  even  higher  light  levels.  This  approach,  known  as 
laser  induced  fluorescence  (LIF),  was  used  in  [Deusch  and  Dracos 
2001]  to  measure  time- varying  3D  concentration  of  a  fluorescent 
dye  in  a  water  jet  using  a  number  of  different  scanning  geometries. 


Figure  1:  The  laser  is  deflected  off  a  mirror  galvanometer  and 
through  a  cylindrical  lens,  creating  a  vertical  sheet  of  light  which 
can  be  scanned  horizontally  from  side  to  side. 

[Bertocchi  et  al.  2004]  measured  the  phase  function  of  a  cloud 
of  carbon  black  particles  by  rotating  a  photodiode  around  a  laser- 
illuminated  sample.  In  our  work,  we  measure  the  phase  function 
with  a  single  photograph  using  a  conical  mirror.  This  approach  is 
similar  to  that  of  [Dana  and  Wang  2004],  who  used  a  parabolic 
mirror  to  measure  outgoing  light  distributions  from  surfaces. 

3  Data  Capture 

Our  scanning  setup  is  shown  in  Figure  1 .  The  key  components  are 
a  laser,  a  mirror  galvanometer,  a  cylindrical  lens,  and  a  high-speed 
camera  (not  seen  in  Figure  1).  The  galvanometer  allows  the  laser  to 
be  scanned  back  and  forth  along  a  horizontal  line.  After  reflecting 
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Figure  2:  Eight  images  captured  during  a  single  sweep  of  the  laser  plane. 


off  the  mirror,  the  laser  is  spread  into  a  vertical  sheet  of  light  by  the 
cylindrical  lens.  This  sheet  of  light  creates  an  illuminated  plane  of 
smoke,  which  the  camera  views  from  a  perpendicular  direction. 

During  scanning,  the  galvanometer  sweeps  the  laser  sheet  from 
the  front  to  the  back  of  the  smoke  volume,  while  the  camera  cap¬ 
tures  images  of  the  scattered  light.  The  galvanometer  then  rapidly 
jumps  back  to  the  front  of  the  smoke  volume  and  the  process  is  re¬ 
peated.  In  this  work  we  capture  200  images  during  each  volume 
scan.  At  5000  frames  per  second,  this  allows  the  volume  to  be 
scanned  at  25  Hz.  We  placed  both  the  camera  and  galvanometer  3 
meters  from  the  working  volume,  and  chose  the  camera  lens,  cylin¬ 
drical  lens,  and  galvanometer  scan  angle  so  that  the  camera  field 
of  view  and  laser  frustum  were  both  6°.  This  provided  a  working 
volume  of  approximately  30x30x30  cm. 

The  galvanometer  control  software  also  triggers  the  camera,  al¬ 
lowing  the  frame  capture  to  be  synchronized  with  the  position  of 
the  laser  slice.  This  assures  that  corresponding  slices  in  successive 
captured  volumes  are  sampled  at  the  same  position. 

The  high  frame  rate  and  the  small  fraction  of  the  total  light  scat¬ 
tered  to  the  camera  require  a  relatively  powerful  laser.  We  use  an 
argon  ion  laser  that  produces  3  watts  of  light  at  a  set  of  wavelengths 
closely  clustered  around  500  nm. 

3.1  Calibration 

Interpreting  the  image  data  as  a  density  field  requires  knowing  the 
geometry  and  radiometry  of  the  camera  and  lighting  setup.  We  use 
a  planar  checkerboard  pattern  to  calibrate  the  pose  and  intrinsic  pa¬ 
rameters  of  the  camera  using  the  technique  of  [Zhang  2000]. 


(a)  (b) 

Figure  3:  (a)  Filter  with  horizontal  lines  used  for  characterizing 
light  volume,  (b)  Captured  image  of  laser  through  filter. 

We  calibrate  the  position  and  intensity  of  the  laser,  as  well  as  the 
position  of  the  sequential  laser  planes  P^,  by  placing  a  pattern  of 
horizontal  lines  between  the  cylindrical  lens  and  the  working  vol¬ 
ume.  This  changes  the  vertical  slice  of  light  into  a  series  of  dots. 
We  then  place  a  checkerboard  at  an  angle  such  that  it  is  illuminated 
by  the  laser  and  also  visible  to  the  camera.  Because  the  position 
of  the  checkerboard  is  determined  by  the  camera  calibration  pro¬ 
cedure,  we  can  then  determine  the  position  of  a  given  dot  of  light 
in  a  given  frame  corresponding  to  one  position  of  the  laser  slice. 
Moving  the  checkerboard  to  another  position  allows  the  same  dot 
of  light  to  be  observed  at  a  different  3D  position.  Connecting  these 
dots  then  gives  a  line  which  passes  through  the  nodal  point  Lc  of 


the  laser  scanner.  Repeating  this  for  another  dot  gives  another  such 
line,  and  intersecting  the  two  lines  determines  L^. 

Similarly,  any  two  identified  points  on  the  laser  line  for  a  given 
slice  5,  together  with  L^,  determines  the  plane  P^  of  illumination. 

We  observed  that  the  intensity  of  illumination  varied  as  a  func¬ 
tion  of  slice  ^  and  of  elevation  angle  0  within  each  laser  slice.  To 
correct  for  this,  we  placed  a  uniform  diffuse  plane  at  an  angle  where 
it  was  visible  to  both  the  laser  and  the  camera  and  captured  a  se¬ 
quence  of  frames.  As  the  laser  scans  this  refiectance  standard,  the 
observed  intensities  are  directly  proportional  to  the  intensity  of  laser 
light  for  each  laser  plane  and  pixel  position.  Having  calibrated  the 
laser  planes  P^  and  the  camera  position,  we  can  find  the  3D  point 
V  corresponding  to  each  laser  plane  and  pixel  position,  and  apply 
the  appropriate  intensity  compensation  when  computing  densities 
along  the  ray  from  the  laser  position  Lc  through  the  point  v.  Al¬ 
though  this  corrects  for  the  relative  intensity  differences  across  the 
laser  frustum,  we  should  note  that  we  do  not  measure  the  absolute 
intensity  of  the  laser.  The  resulting  density  fields  are  therefore  only 
recovered  up  to  an  unknown  scale  factor. 

We  have  assumed  that  image  intensity  values  can  be  directly  in¬ 
terpreted  as  density  values.  This  assumes  that  the  effects  of  extinc¬ 
tion  and  multiple  scattering  within  the  volume  are  negligible.  Al¬ 
though  we  found  that  this  assumption  held  for  the  smoke  volumes 
we  captured,  this  assumption  will  fail  when  the  densities  become 
very  high  such  as  for  thick  smoke  or  dyes  in  water,  or  when  the 
scattering  volume  becomes  large. 

4  Measuring  scattering  parameters 

To  render  a  captured  density  volume  accurately,  we  must  also  know 
the  basic  scattering  characteristics  of  the  medium.  In  particular  we 
must  know  the  phase  function,  which  describes  the  angular  distribu¬ 
tion  of  scattered  light,  and  the  albedo,  which  describes  the  tendency 
of  the  medium  to  scatter  light  rather  than  absorb  it. 

To  measure  these  quantities,  we  use  the  setup  shown  in  Figure  4. 
Smoke  is  confined  within  a  transparent  tank.  A  fan  circulates  the  air 
to  maintain  homogeneity.  A  spherical  glass  observation  chamber  is 
added  at  the  top. 

4.1  Phase  Function 

The  phase  function  of  a  scattering  medium  describes  the  distribu¬ 
tion  of  outgoing  scattered  light  per  scattering  event.  It  is  assumed 
to  be  a  function  only  of  the  angle  between  the  direction  of  the  in¬ 
coming  light  and  the  direction  of  scattered  light,  or  phase  angle. 

We  developed  a  novel  apparatus  to  measure  the  phase  function 
from  a  single  photograph.  We  first  fill  the  tank  and  observation 
chamber  with  smoke.  Relatively  thin  smoke  is  used  to  minimize  the 
effect  of  multiple  scattering.  We  then  direct  the  laser  beam  through 
the  spherical  observation  chamber.  A  strip  of  a  45  degree  conical 
mirror  encircles  the  observation  chamber,  as  seen  in  Figure  5(a). 
Two  small  holes  are  drilled  through  the  conical  mirror  to  allow  the 
laser  to  pass  through  it  into  the  observation  chamber,  and  to  exit 
without  creating  unwanted  refiections  or  stray  light. 


Figure  4:  Setup  for  measuring  phase  function  and  albedo.  For  phase 
function  measurement,  the  laser  is  directed  through  the  spherical 
chamber  on  top.  For  albedo  measurement  the  laser  enters  the  lower 
tank,  as  shown  here. 


of  extinction  is  easily  observable,  a  high  smoke  density  is  used. 
The  laser  beam  is  directed  through  the  tank  and  a  high  dynamic 
range  image  is  captured,  as  shown  in  Figure  5(b).  The  effects  of 
multiple  scattering  along  the  imaged  laser  line  are  removed  at  each 
horizontal  position  by  subtracting  the  average  of  a  small  window  of 
pixels  above  and  below  the  laser  line. 

To  compute  the  albedo  we  measure  the  intensity  L/  of  the  laser 
from  a  diffuse  reflectance  standard  oriented  at  45°  to  both  the  cam¬ 
era  and  the  laser.  If  the  phase  function  were  isotropic  and  all  of  the 
light  extinction  were  due  to  scattering,  the  light  intensity  scat¬ 
tered  from  the  smoke  at  90°  as  measured  by  a  camera  pixel  is: 


Ls  = 


V2Lik 
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(2) 


where  k  is  the  observed  fractional  extinction  per  pixel,  and  the  fac¬ 
tor  of  \/2/4  accounts  for  the  greater  than  isotropic  efficiency  of  the 
diffuse  reflector  at  a  45°  exitant  angle.  Accounting  for  the  known 
phase  function,  we  then  compute  the  albedo  as: 


4L, 

\/2L,fe<l)(90) 


(3) 


Figure  5:  (a)  Two  views  of  the  phase  function  capture  setup.  From 
above  the  conical  mirror  reflects  light  coming  from  the  center  of 
the  laser  line,  creating  a  circle  of  light  that  captures  all  excitant 
directions,  (b)  Original  extinction  image  (top)  and  extinction  image 
with  effect  of  multiple  scattering  removed  (bottom). 


Figure  6:  (a)  Measured  phase  function  (red)  with  best- fit  Henyey- 
Greenstein  lobe  (g=0.32)  (blue),  (b)  Log-linear  plot,  showing  the 
expected  exponential  decay  of  light  intensity.  In  this  case,  8.7%  of 
the  light  is  scattered  or  absorbed  per  centimeter. 


When  imaged  from  above,  the  conical  mirror  allows  the  light 
scattered  from  the  center  of  the  observation  chamber  to  be  seen 
simultaneously  from  all  directions.  An  example  of  such  an  image  is 
shown  on  the  right  in  Figure  5(a).  We  capture  a  high  dynamic  range 
image  of  this  area  and  And  the  image  intensities  corresponding  to 
each  outgoing  angle. 

The  normalized  phase  function  is  derived  from  the  observed  in¬ 
tensities  I{0)  by  first  scaling  all  observations  by  sin(0)  to  correct 
for  foreshortening  of  the  laser  line,  and  then  normalizing  this  quan¬ 
tity  to  have  integral  An  over  the  sphere  of  outgoing  directions: 

/(}^/(0)  sin(0)  •  sm{6)d6 

The  measured  phase  function  can  be  seen  in  Figure  6.  It  exhibits 
the  strong  forward  scattering  common  to  many  scattering  media. 

4.2  Albedo 

The  albedo  of  a  scattering  medium  is  defined  as  the  ratio  of  scat¬ 
tered  light  to  the  sum  of  scattered  light  and  absorbed  light. 

Given  the  known  phase  function,  the  albedo  may  be  measured 
using  the  simple  setup  illustrated  in  Figure  4.  To  assure  the  rate 


5  Results 

We  visualize  our  time-varying  data  sets  using  a  Monte  Carlo  ray 
tracing  renderer.  A  data  set  typically  consists  of  approximately  120 
volumes,  each  with  a  resolution  of  640x480x200.  We  store  the  re¬ 
covered  density  values  in  voxel  grids,  and  for  each  frame  we  use 
ray  marching  to  step  through  the  volume  along  the  camera  rays.  At 
each  step  we  interpolate  the  volume’s  density  and  sample  the  in¬ 
cident  illumination  to  compute  the  amount  of  being  light  scattered 
towards  the  camera,  as  well  as  the  attenuation  due  to  extinction. 
Here,  we  use  our  measured  values  for  albedo  and  phase  function 
to  accurately  determine  the  ratio  of  scattered  to  absorbed  light  and 
the  angular  distribution  of  the  scattered  light.  For  renderings  us¬ 
ing  environmental  illumination,  we  sample  the  incident  light  inten¬ 
sity  using  an  importance  sampling  algorithm  based  on  [Pharr  and 
Humphreys  2004]. 

Figure  7  shows  three  renderings  of  captured  smoke  volumes  un¬ 
der  novel  viewpoints  and  illumination.  To  make  the  smoke  more 
easily  visible,  the  scale  factor  for  the  recovered  smoke  density  has 
been  chosen  to  be  significantly  higher  than  for  the  actual  smoke. 
The  measured  albedo  for  this  smoke  was  0.62.  We  are  also  able 
to  change  the  appearance  of  the  smoke  by  modifying  the  albedo, 
extinction  and  phase  function.  Examples  of  such  renderings  are 
included  on  the  accompanying  video. 


6  Conclusion 


We  have  presented  a  technique  for  capturing  time-varying  density 
of  participating  media,  and  demonstrated  its  application  to  the  cap¬ 
ture  of  smoke.  We  have  also  demonstrated  realistic  renderings  mak¬ 
ing  use  of  measured  scattering  parameters  for  the  medium. 

For  future  work,  compensating  for  the  effects  of  extinction  and 
multiple  scattering  would  improve  accuracy  for  large  volumes  or 
when  the  density  of  scatterers  is  high.  Such  compensation  should 
be  possible  when  the  total  attenuation  from  extinction  and  blurring 
from  multiple  scattering  are  not  excessive. 
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Eigure  7:  (a)  A  captured  smoke  volume  rendered  with  a  point  light, 
(b)  The  same  smoke  volume  rendered  with  two  spotlights  of  dif¬ 
ferent  colors,  (c)  A  smoke  volume  rendered  with  environmental 
illumination. 


